Analysis of Various Evaluation Measures for Diversity
نویسندگان
چکیده
Evaluation measures play a vital role in analyzing the performance of a system, comparing two or more systems, and optimizing systems to perform some task. In this paper, we analyze and highlight the strengths and weaknesses of commonly used measures for evaluating the diversity in search results. We compare MAP-IA, α-nDCG, and ERR-IA using data from TREC’09 web track diversity runs and simulated data. We describe a class of test sets that could be used to compare evaluation measure and systems used for diversifying search results.
منابع مشابه
Evaluation of Similarity Measures for Template Matching
Image matching is a critical process in various photogrammetry, computer vision and remote sensing applications such as image registration, 3D model reconstruction, change detection, image fusion, pattern recognition, autonomous navigation, and digital elevation model (DEM) generation and orientation. The primary goal of the image matching process is to establish the correspondence between two ...
متن کاملGenetic Diversity Evaluation of Lemon balm (Melissa officinalis L.) Ecotypes Using Morphological Traits and Molecular Markers
Genetic diversity of 12 lemon balm ecotypes was evaluated using agronomic traits as well as ISSR and RAPD markers. Results of analysis of variance showed high diversity among the studied ecotypes. Cluster analysis using UPGMA method grouped the ecotypes into three different groups based on the agronomic traits. Twelve ISSR primers created 106 polymorphic bands among the studied ecotypes. An ISS...
متن کاملEvaluation of recommender systems: A multi-criteria decision making approach
The evaluation and selection of recommender systems is a difficult decision making process. This difficulty is partially due to the large diversity of published evaluation criteria in addition to lack of standardized methods of evaluation. As such, a systematic methodology is needed that explicitly considers multiple, possibly conflicting metrics and assists decision makers to evaluate and find...
متن کاملEvaluation of Genetic Diversity in Iranian Violet (Viola spp) Populations Using Morphological and RAPD Molecular Markers
Recognition of genetic reserves and desirable genes is the basis of breeding programs. So far, in Iran, due to the lack of recognition of genetic resources, a considerable breeding program has not been done on native plants. The study of the genetic diversity of violets as a native plant with ornamental and medicinal uses is the great importance in advancing the breeding goals of this plant. So...
متن کاملEvaluation of Genetic Diversity and Estimation of Heritability and Genetic Correlation Using REML for Different Traits in Grass Pea (Lathyrus sativus L.) Genotypes
Plant breeding researches is based on genetic diversity and evaluation of genetic diversity is also one of the most important steps in introduction of new cultivars. In this study, genetic diversity of 25 grass pea genotypes was studied based on randomized complete block design with three replicates in Khorramabad (Iran). Analysis of variance showed significant differences among genotypes for m...
متن کامل